Electronic apparatus and method for taking a photograph in electronic apparatus

ABSTRACT

Various exemplary embodiments related to an electronic apparatus and a method for taking a photograph in the electronic apparatus are disclosed, and according to an exemplary embodiment, the electronic apparatus may include a display that displays a screen; a depth sensor that outputs a first image signal and depth information; an image sensor that outputs a second image signal; and a control unit that controls to display a preview screen on the display using the first image signal, obtain both depth information of a photographing moment and an image of the photographing moment using the second image signal in response to a request of photographing, and store the image and the depth information. Also, other various exemplary embodiments may be possible.

CROSS-REFERENCE TO RELATED APPLICATION(S) AND CLAIM OF PRIORITY

The present application is related to and claims the priority under 35U.S.C. §119(a) to Korean Application Serial No. 10-2014-0053492, whichwas filed in the Korean Intellectual Property Office on May 2, 2014, theentire content of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic apparatus and a cameratechnology of the electronic apparatus.

BACKGROUND

Owing to popular propagation of a digital camera, now the digital camerais recognized as an electronic apparatus routinely used by an ordinaryperson. Using frequency of a camera by the ordinary person has beenincreasing as many electronic apparatuses such as a cellular phone, asmartphone and so on as well as the digital camera embed the camera.

Thus, in a recent electronic apparatus, a function capable of performingan image and data communication functions in a high speed in addition toa voice communication function are essentially implemented, and inparticular, the electronic apparatus includes an imaging module to havea function of the digital camera.

As described above, the digital camera included in the electronicapparatus has functions requested in base photographing, storing andtransferring in early days, in order to satisfy various requirements ofa user, and technology development for improving performance, qualityand function has been performed. Especially, in these days, researchwith respect to technology capable of applying various image effects toa photographed image has been performed to great extent.

SUMMARY

In order to apply various effects to the photographed image, variousinformation related to the image as well as a high resolution image areobtained.

For this, the electronic apparatus having the camera function, obtainsas much meta information related to the image while displaying a previewimage using one image sensor, photographs the image according to aphotographing instruction by the user, and thus the electronic apparatusmay obtain the meta information related to the image and the image.

However, as described above, when the electronic apparatus obtains themeta information (e.g., depth information) related to the image and theimage using one imaging sensor, the electronic apparatus obtains theimage after obtaining the meta information related to the image first,or the electronic apparatus obtains the meta information related to theimage after obtaining the image, and thus there is a difference betweenan obtaining time of the meta information related to the image and anobtaining time of the real image.

Especially, when the electronic apparatus obtains the depth information(also referred to as distance information) related to the image and theimage together, it is impossible to obtain high resolution distanceinformation and the high resolution image simultaneously without a timedifference using one imaging module. This is because the imaging moduleshould use optics having a high Modulation Transfer Function (MTF)feature in order to obtain the high resolution image, the higher MTF is,the lower a Depth Of Field (DOF) is, in order to increase the low DOF, alens should be moved, and thus the process takes time.

As described above, the meta information related to the image and theimage are not obtained simultaneously, and thus the electronic apparatusmay not provide the image effect using the obtained image in real time.

Thus, according to various exemplary embodiments of the presentdisclosure, an electronic apparatus and a method for taking a photographin the electronic apparatus capable of simultaneously obtaining the metainformation related to the image and the image using a depth sensor andthe image sensor instead of one imaging sensor may be provided.

In addition, according to various exemplary embodiments of presentdisclosure, an electronic apparatus and a method for taking a photographin the electronic apparatus, capable of providing image effects usingthe meta information related to the image and the image in real time, bysimultaneously obtaining the meta information related to the image andthe image, may be provided.

According to various exemplary embodiments of the present disclosure, anelectronic apparatus includes a display that displays a screen; a depthsensor that outputs a first image signal and depth information; an imagesensor that outputs a second image signal; and a control unit thatcontrols to display a preview screen on the display using the firstimage signal, obtain both depth information of a photographing momentand an image of the photographing moment using the second image signalin response to a request of photographing, and store the image and thedepth information.

According to various exemplary embodiments of the present disclosure, amethod for taking a photograph in an electronic apparatus, includesreceiving a first image signal and depth information from a depth sensorand receiving a second image signal from an image sensor; displaying apreview screen on a display using the first image signal; obtaining bothdepth information of a photographing moment and an image of thephotographing moment using the second image signal according to arequest of photographing; and storing the image and the depthinformation.

According to various exemplary embodiment of the present disclosure, thedepth information related to the image and the image may besimultaneously obtained using the depth sensor and the image sensorinstead of one imaging sensor.

In addition, according to various exemplary embodiments of the presentdisclosure, the image effect using the meta information related to theimage and the image may be provided in real time by simultaneouslyobtaining the distance information related to the image and the image.

Before undertaking the DETAILED DESCRIPTION below, it may beadvantageous to set forth definitions of certain words and phrases usedthroughout this patent document: the teems “include” and “comprise,” aswell as derivatives thereof, mean inclusion without limitation; the term“or,” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean toinclude, be included within, interconnect with, contain, be containedwithin, connect to or with, couple to or with, be communicable with,cooperate with, interleave, juxtapose, be proximate to, be bound to orwith, have, have a property of, or the like; and the term “controller”means any device, system or part thereof that controls at least oneoperation, such a device may be implemented in hardware, firmware orsoftware, or some combination of at least two of the same. It should benoted that the functionality associated with any particular controllermay be centralized or distributed, whether locally or remotely.Definitions for certain words and phrases are provided throughout thispatent document, those of ordinary skill in the art should understandthat in many, if not most instances, such definitions apply to prior, aswell as future uses of such defined words and phrases.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure and itsadvantages, reference is now made to the following description taken inconjunction with the accompanying drawings, in which like referencenumerals represent like parts:

FIG. 1 is a schematic concept view illustrating an electronic apparatusaccording to an exemplary embodiment of the present disclosure;

FIG. 2 is a schematic concept view illustrating an operation of theelectronic apparatus according to an exemplary embodiment of the presentdisclosure;

FIG. 3 is a flowchart illustrating a method for taking a photograph inthe electronic apparatus according to an exemplary embodiment of thepresent disclosure;

FIG. 4 is a flowchart illustrating a method for applying a focusingeffect to a stored image in the electronic apparatus according to anexemplary embodiment of the present disclosure;

FIG. 5 illustrates a configuration of an electronic apparatus to whichthe method for taking the photograph according to various exemplaryembodiments of the present disclosure is applied; and

FIGS. 6 and 7 illustrate a user interface screen when the electronicapparatus according to the various exemplary embodiments takes aphotograph.

DETAILED DESCRIPTION

FIGS. 1 through 7, discussed below, and the various embodiments used todescribe the principles of the present disclosure in this patentdocument are by way of illustration only and should not be construed inany way to limit the scope of the disclosure. Those skilled in the artwill understand that the principles of the present disclosure may beimplemented in any suitably arranged system or device. Terms used invarious exemplary embodiments of the present disclosure will bedescribed shortly, and the various exemplary embodiments of the presentdisclosure will be described in detail.

With respect to the terms in the various embodiments of the presentdisclosure, the general terms which are currently and widely used areselected in consideration of functions of structural elements in thevarious embodiments of the present disclosure. However, meanings of theterms may be changed according to an inventor's intention, a judicialprecedent, appearance of a new technology, and the like. In addition, ata certain case, a term arbitrarily selected by the applicant may beused. In such a case, the meaning of the term will be described indetail at the corresponding part in the description of the presentdisclosure. Thus, the terms used in various embodiments of the presentdisclosure should be defined based on the meanings of the terms and theoverall contents of the embodiments of the present disclosure instead ofsimple titles of the terms.

In various embodiments of the present disclosure, when a part “includes”a component element, it does not mean excluding other component elementsbut it shall be construed that one or more other components can beincluded unless they are specifically described to the contrary. Also,the term, such as “unit”, “module”, or the like, means a unit forprocessing at least a function or an operation, and may be embodiedthrough hardware, software, or a combination hardware and software.

Hereinafter, the various embodiments of the present disclosure will bedescribed in detail with reference to accompanying drawings. However,the present disclosure is not limited or restricted by the embodiments.The same reference numerals of each of the drawings may be designated tomembers performing the same function.

An electronic device according to various embodiments of the presentdisclosure may be an electronic device capable of having a camerafunction. For example, the electronic device may include at least one ofa smart phone, a tablet Personal Computer (PC), a mobile phone, a videophone, an e-book reader, a desktop PC, a laptop PC, a netbook computer,a PDA, a Portable Multimedia Player (PMP), an MP3 player, a mobilemedical device, a camera, a wearable device (for example, aHead-Mounted-Device (HMD) such as electronic glasses, electronicclothes, an electronic bracelet, an electronic necklace, an electronicappcessory, an electronic tattoo, and a smart watch.

According to some embodiments, the electronic device may be a smart homeappliance. The smart home appliance may include at least one of, forexample, a television, a Digital Video Disk (DVD) player, an audio, arefrigerator, an air conditioner, a vacuum cleaner, an oven, a microwaveoven, a washing machine, an air cleaner, a set-top box, a TV box (forexample, Samsung HomeSync™, Apple TV™, or Google TV™), a game console,an electronic dictionary, an electronic key, a camcorder, and anelectronic picture frame.

According to some embodiments, the electronic device may include atleast one of a navigation device and an in-vehicle infotainment device.

According to some embodiments, the electronic device may include atleast one of a part of furniture or a building/structure, an electronicboard, an electronic signature receiving device, and a projector. Theelectronic device according to the present disclosure may be acombination of one or more of the aforementioned various devices.Further, it will be apparent to those skilled in the art that theelectronic device according to the present disclosure is not limited tothe above-mentioned devices, and the present disclosure may be appliedto any kind of device having a camera function.

FIG. 1 is a concept view illustrating a concept of an electronicapparatus according to an exemplary embodiment of the presentdisclosure. Referring to FIG. 1, the electronic apparatus 10 may includea depth sensor 12, an image sensor 14, an input signal processor 22, afirst memory 24, a main operating system 26, a bus 28, a second memory30, an output signal processor 32 and a display 34.

The depth sensor 12 may form an image by focusing light input through alens to output a first image signal having a comparatively lowerresolution and a higher Depth Of Field (DOF) (high F-number) than animage of the image sensor 14. In photographing, when a lens is focusedon a subject, the focused subject has a front surface and a rearsurface. Here, a DOF may indicate a focused area. When there is a largefocused space (including a front side and a rear side of the subject)around the subject, the DOF may be deep (i.e. high). In contrast, whenthe focused space (including the front side and the rear side of thesubject) around the subject is not large, the DOF may be comparativelynot deep (i.e. not high). The depth sensor 12 may analyze the firstimage signal to output meta information. The meta information mayinclude depth information. The depth information may be associated withdistance information which indicates whether each pixel of a first imageis close to or far from the lens. The nearer each of pixels in the firstimage is to the lens, the higher a depth numerical value may be. Also,the farther the each of the pixels in the first image is from the lens,the lower the depth numerical value may be. The depth information mayinclude information needed to extract the distance information of thefirst image.

The image sensor 14 forms an image using the light input through thelens to obtain a second image signal having a comparatively higherresolution than the image of the depth sensor 12. At this time, theimage sensor 14 may be disposed as closely as possible to the depthsensor 12 in order to obtain the second image signal equal to a sight ofthe depth sensor 12.

The input signal processor 22 may be connected to each of the depthsensor 12 and the image sensor 14 through a serial interface. The inputsignal processor 22 may receive the first image signal having thecomparatively low resolution and high DOF and the meta information,e.g., the depth information from the depth sensor 12, and may receivethe second image signal having the comparatively high resolution fromthe image sensor 14. The input signal processor 22 may process the firstimage signal received from the depth sensor 12 and the second imagesignal received from the image sensor 14. The input signal processor 22may extract distance information using the depth information receivedfrom the depth sensor 12. The input signal processor 22 may match thedistance information to the second image signal.

The first memory 24 may be an exclusive memory of the input signalprocessor 22. The first memory 24 may temporarily store the first imagesignal, the second image signal or the depth information input to theinput signal processor 22, and may store data when the input signalprocessor 22 processes a signal. The first memory 24 may be operatedindependently of the main operating system 26, and may be connected tothe input signal processor 22 through a bus or a serial communication.

The main operating system 26 may transmit a signal to the input signalprocessor 22 and receive the signal from the input signal processor 22through a serial interface. The main operating system 26 may operate akernel and various sub system drivers of the electronic apparatus 10, asa main Operating System (OS) of the electronic apparatus 10, and may beincluded in a controller capable of controlling overall operation of theelectronic apparatus 10.

The bus 28 may be a device which enables the main operating system 26 tocommunicate with various sub systems of the electronic apparatus 10 athigh speed. For example, the bus 28 may be a device which enables themain operating system 26 to communicate with the input signal processor22, the second memory 30, the output signal processor 32 and so on athigh speed.

The second memory 30 may store various data required in operating theelectronic apparatus, as a main memory, the data may be stored by themain operating system 26, and the stored data may be read by the mainoperating system 26.

The output signal processor 32 may process the first image signal or thesecond image signal processed by the input signal processor 22 into adisplayable image data to be displayed on the display 34.

The display 34 may display the image data provided by the output signalprocessor 32, as a main image display device of the electronicapparatus.

FIG. 2 is a schematic concept view illustrating an operation of theelectronic apparatus according to an exemplary embodiment of the presentdisclosure. According to FIG. 2, the electronic apparatus 10 may executea camera application 210 according to an exemplary embodiment.

Referring to FIG. 2, when the camera application 210 is executed by theuser, the electronic apparatus 10 may start a preview mode 212.

When the preview mode starts, the electronic apparatus 10 may initializethe depth sensor 12 and the image sensor 14 so that the input signalprocessor 22 may receive the depth information and the first imagesignal having the comparatively low resolution and the high DOF from thedepth sensor 12 and may receive the second image signal having thecomparatively high resolution from the image sensor 14.

The input signal processor 22 may process the first image signal of thelow resolution in the preview mode to provide a preview image signal,and the preview image signal may be processed through the output signalprocessor 32 to be displayed on the display 34 as a preview screen. Inaddition, the input signal processor 22 may extract the distanceinformation using the depth information output from the depth sensor 12in the preview mode.

When a focus application 214 is requested, the electronic apparatus 10may apply a focusing effect to the preview screen using the distanceinformation. According to an exemplary embodiment, an area where thefocus is applied may be a partial area of the screen, and may be apredetermined area or an area selected by the user. According to anexemplary embodiment, when the area where the focus is applied is acentral area, the electronic apparatus 10 applies an out-of-focus effectto a remaining area except for the central area by using the distanceinformation, and may display the preview screen where the out-of-focuseffect is applied. According to an exemplary embodiment, when the areawhere the focus is applied is the selected area, the electronicapparatus 10 applies the out-of-focus effect to a remaining area exceptfor the selected area by using the distance information, and may displaythe preview screen where the out-of-focus effect is applied.

When a photographing 216 is requested, the electronic apparatus 10obtains a high resolution image from the second image of a photographingmoment through the input signal processor 22, may obtain depthinformation of the photographing moment, and may match the highresolution image to the depth information of the photographing moment.The matched high resolution image and the depth information of thephotographing moment may be transferred to the main operating system 26.The main operating system 26 may store the high resolution image and thedepth information to the second memory 30.

The electronic apparatus 10 may apply the focusing effect to the highresolution image, using the stored high resolution image and the depthinformation. According to an exemplary embodiment, an area where thefocus is applied may be a partial area of the high resolution image, andmay be a predetermined area or an area selected by the user. Accordingto an exemplary embodiment, when the area where the focus is applied isa central area, the electronic apparatus 10 applies the out-of-focuseffect to a remaining area except for the central area by using thedistance information, and may display the high resolution image wherethe out-of-focus effect is applied. According to an exemplaryembodiment, when the area where the focus is applied is the selectedarea, the electronic apparatus 10 applies the out-of-focus effect to aremaining area except for the selected area by using the distanceinformation, and may display the high resolution image where theout-of-focus effect is applied.

FIG. 3 is a flowchart illustrating a method for taking a photograph inthe electronic apparatus according to an exemplary embodiment of thepresent disclosure. Referring to FIG. 3, the electronic apparatus 10 maydetermine whether the camera application is executed at operation 302.If, the camera application is executed, the electronic apparatus 10 mayreceive the first image signal and the depth information from the depthsensor 12 and receive the second image signal from the image sensor 14at operation 304. According to an exemplary embodiment, the first imagesignal may be the low resolution image signal and the second signal maybe the high resolution image signal.

The electronic apparatus 10 may display the first image corresponding tothe first image signal on the preview screen at operation 306. Accordingto an exemplary embodiment, the electronic apparatus 10 may process thefirst image signal in the preview mode through the input signalprocessor 22 to provide the preview image signal, and the preview imagesignal may be processed through the output signal processor 32 to bedisplayed on the display 34 as the preview screen.

The electronic apparatus 10 may determine whether the focusing isapplied at operation 308. According to an exemplary embodiment, thefocusing may be applied according to a predetermined focusingapplication decision, and may be applied according to a user's request.When it is determined that the focusing is applied, the electronicapparatus 10 may extract the distance information using the depthinformation and apply the focusing effect to the preview screen usingthe distance information at operation 310.

According to an exemplary embodiment, the area where the focus isapplied may be the partial area of the screen, and may be thepredetermined area or the area selected by the user. According to anexemplary embodiment, when the area where the focus is applied is thecentral area, the electronic apparatus 10 applies the out-of-focuseffect to the remaining area except for the central area by using thedistance information, and may display the preview screen where theout-of-focus effect is applied. According to an exemplary embodiment,when the area where the focus is applied is the selected area, theelectronic apparatus 10 applies the out-of-focus effect to the remainingarea except for the selected area using the distance information, andmay display the preview screen where the out-of-focus effect is applied.

The electronic apparatus 10 may determine whether the photographingrequest occurs at operation 312. When the photographing request occurs,the electronic apparatus 10 may obtain the depth information of thephotographing moment simultaneously while obtaining the image of thephotographing moment from the second image signal at operation 314.According to an exemplary embodiment, the electronic apparatus 10 mayobtain the high resolution image and the depth information of thephotographing moment.

The electronic apparatus 10 may match the obtained image to the depthinformation and store at operation 316. The electronic apparatus 10 mayapply the focusing effect to the stored image, using the stored imageand the depth information.

FIG. 4 is a flowchart illustrating a method for applying the focusingeffect to the stored image in the electronic apparatus according to anexemplary embodiment of the present disclosure. Referring to FIG. 4, theelectronic apparatus 10 may determine whether the stored image isselected at operation 402. According to an exemplary embodiment, theelectronic apparatus 10 may determine whether an image, to which thefocusing effect is applied, among images stored in the second memory 30is selected by the user.

When the stored image is selected, the electronic apparatus 10 maydetermine whether the focusing is applied to the selected image atoperation 404. When it is determined that the focusing is applied, theelectronic apparatus 10 may apply the focusing effect to the selectedimage using the stored depth information corresponding to the selectedimage at operation 406. According to an exemplary embodiment, the areawhere the focus is applied may be the partial area of the screen, andmay be the predetermined area or the area selected by the user.According to an exemplary embodiment, when the area where the focus isapplied is the central area, the electronic apparatus 10 applies theout-of-focus effect to the remaining area except for the central areausing the distance information, and may display the preview screen wherethe out-of-focus effect is applied. According to an exemplaryembodiment, when the area where the focus is applied is the selectedarea, the electronic apparatus 10 may apply the out-of-focus effect tothe remaining area except for the selected area using the distanceinformation. The electronic apparatus 10 may display the image where thefocusing effect is applied at operation 408.

FIG. 5 is a view illustrating a configuration of an electronic apparatus100 to which the method for taking the photograph according to variousexemplary embodiments of the present disclosure is applied.

Referring to FIG. 5, the electronic apparatus 100 may include a controlunit 110, a communication unit 120, a storage unit 130, a display unit140, an input/output unit 150 and a camera unit 160.

The control unit 110 may include a Central Processor Unit (CPU) 111. Thecontrol unit 110 may further include a plurality of Digital SignalProcessors (DSPs). The DSPs may include an input signal processor 115and an output signal processor 119.

The CPU 111 may include a single core, a dual core, a triple core, or aquad core. The CPU 111 may be mutually connected with a ROM 112, a RAM113, the input signal processor 115, a memory 117, the output signalprocessor 119 through an internal bus. The control unit 110 may controlthe communication unit 120, the storage unit 130, the display unit 140,the input/output unit 150 and the camera unit 160. For example, thecontrol unit 110 may perform a function of controlling overalloperations of the electronic apparatus 100, and control a signal flowbetween structural elements.

The input signal processor 115 may be connected to each of a depthsensor 164 and an image sensor 166. The input signal processor 115 mayreceive the depth information and the first image signal having thecomparatively low resolution and the high DOF from the depth sensor 164,and may receive the second image signal having the comparatively highresolution from the image sensor 166. The input signal processor 115 mayprocess the first image signal received from the depth sensor 164 andthe second image signal received from the image sensor 166. The inputsignal processor 115 may extract the distance information using thedepth information received from the depth sensor 164. The input signalprocessor 115 may match the distance information to the second imagesignal.

The memory 117 may be an exclusive memory of the input signal processor115. The memory 117 may temporarily store the first image signal, thesecond image signal or the depth information input to the input signalprocessor 115, and may store data when the input signal processor 115processes a signal. The memory 117 may be operated independently of theCPU 111, and may be connected to the input signal processor 115 througha bus or a serial communication.

The output signal processor 119 may process the first image signal orthe second image signal processed by the input signal processor 115 intoa displayable image data to display on the display unit 140.

The communication unit 120 may enable the electronic apparatus 100 to beconnected to an external device. The external device may include otherelectronic devices (not shown) such as a cellular phone (not shown), asmartphone (not shown), a tablet PC, etc. For example, the communicationunit 120 may include at least one of a mobile communication module, aNear Field Communication (NFC) module, a WIFI module and a Bluetooth(BT) module. The communication unit 120 enables the electronic apparatus100 to transmit or receive a wireless signal for a voice call, a videocall, a text message (SMS) or a multimedia message (MMS) to or fromanother electronic device, such as the cellular phone (not shown), thesmartphone (not shown), the tablet PC and so on having a telephonenumber input to the electronic apparatus 100 according to a control ofthe control unit 110. In addition, the communication unit 120 maytransmit or receive an NFC signal to or from another electronic devicethrough the NFC module, may be connected to a BT communication networkthrough the BT module, or may be connected to a WIFI communicationnetwork through the WIFI module.

The storage unit 130 may store signals or data input/output incorrespondence to the operation of the control unit 110, thecommunication unit 120, the display unit 140, the input/output unit 150and the camera unit 160 under a control of the control unit 110. Thestorage unit 130 may store a plurality of programs and a plurality ofapplications for controlling the electronic apparatus 100 or the controlunit 110 and a program and data for executing various functions (e.g.,the camera application). The term “storage unit” may refer to the ROM112, the RAM 113, the memory 117 in the control unit 110, or a memorycard (not shown), e.g., an SD card and a memory stick, inserted in aterminal 100. The storage unit 130 may include a non-volatile memory, avolatile memory, a Hard Disk Drive (HDD), or a Solid State Drive (SSD).The storage unit 130 may be a machine-readable medium, e.g., acomputer-readable medium, and the phrase ‘machine-readable medium’ maybe defined as a medium for providing data to the machine so that themachine can perform a specific function. The machine readable medium maybe storage medium. The storage unit 130 may include a non-volatilemedium and a volatile medium. All of these media should be of a tangibletype that allows instructions transferred by the media to be detected bya physical instrument in which the machine reads the instructionsthrough the physical instrument. The machine-readable medium may includeat least one of a floppy disk, a flexible disk, a hard disk, a magnetictape, a magnetic tape, a Compact Disc Read-Only Memory (CD-ROM), anoptical disk, a punch card, a paper tape, a Random Access Memory (RAM),a Programmable Read-Only Memory (PROM), an Erasable PROM (EPROM), and aflash-EPROM, but is not limited thereto.

The display unit 140 may be a touch screen, and may provide, to theuser, a graphic user interface when the camera application is performed.For example, the display unit 140 may receive various gesture inputsincluding proximity, a touch and the like, through a user's body, e.g.,fingers including a thumb, or a touchable input unit 159, e.g., a pen.The display unit 140 may be implemented in a resistive type displayscreen, a capacitive type display screen, an infrared type displayscreen, or an ultrasonic wave type display screen. The display unit 140as described above may display a preview screen using the cameraapplication, a preview screen to which the focus is applied, and ascreen of the stored image and so on, under the control of the controlunit 110 according to the exemplary embodiment of the presentdisclosure.

The input/output unit 150 may include a button 151, a microphone 153, aspeaker 155, and an input unit 159. The input/output unit 150 is notlimited to those described above, and may include a cursor controllersuch as a mouse, a trackball, a joystick and cursor directional keys, inorder to control movement of a cursor on the display unit 140 and thecommunication with the control unit 110. One or more buttons 151 may beprovided for the electronic apparatus 100, and may provide various inputsignals to the control unit 110 according to a pushing operation of theuser. The microphone 153 is capable of receiving an input of voice orsound involved in various sound sources to generate electric signalsunder the control of the control unit 110. The speaker 155 may outputsound corresponding to various signals, e.g., a wireless signal, abroadcasting signal, a digital audio file, a digital video file and soon, received through a wireless network access under the control of thecontrol unit 110 to outside of the electronic apparatus 100. The inputunit 159 may be inserted and stored in the electronic apparatus 100, ormay be a separately configured device or object, and in the case thatthe input unit 159 is inserted and stored in the electronic apparatus100, the input unit 159 may be withdrawn or detached. The input unit 159may be an input means such as a stylus pen (hereinafter, referred to asa pen), or a user's finger, which is capable of performing an input suchas proximity or a touch into the display unit 140

The camera unit 160 may include a lens 162, the depth sensor 164 and theimage sensor 166. The depth sensor 164 may form an image by focusinglight input through the lens 162 to output the first image signal havingthe comparatively lower resolution and the higher DOF (high F-number)than an image of the image sensor 166. In photographing, when a lens isfocused on a subject, the focused subject has a front surface and a rearsurface. Here, a DOF may indicate a focused area. When there is largefocused space (including a front side and a rear side of the subject)around the subject, the DOF may be deep (i.e. high). In contrast, whenthe focused space (including the front side and the rear side of thesubject) around the subject is not large, the DOF may be comparativelynot deep (i.e. not high). The depth sensor 164 may analyze the firstimage signal to output the depth information. The depth information maybe associated with distance information which indicates whether each ofpixels in a first image is close to or far from the lens. The nearereach of the pixels in the first image is to the lens, the higher a depthnumerical value may be. Also, the farther the each of the pixels in thefirst image signal is from the lens, the lower the depth numerical valuemay be. The depth information may include information needed to extractthe distance information of the first image.

The image sensor 166 forms an image using the light input through thelens 162 to obtain the second image signal having the comparativelyhigher resolution than the image of the depth sensor 164. At this time,the image sensor 164 may be disposed as closely as possible to the depthsensor 164 in order to obtain the second image signal equal to a sightof the depth sensor 164.

FIGS. 6 and 7 illustrates a user interface screen when the electronicapparatus according to the various exemplary embodiments takes aphotograph.

First, referring to FIG. 6, when an application icon corresponding tothe camera application is touched in the screen of the display unit bythe user, the electronic apparatus 100 may perform a camera applicationlaunching 602 within a predetermined time (for example, 1 second).

When the camera application is launched, the electronic apparatus 100may receive the first image signal of the low resolution from the depthsensor 164, and may receive the second image signal of the highresolution from the image sensor 166.

The electronic apparatus 100 may display a first preview screen 604using the first image signal. The first preview screen 604 may be in astate where the focus is not applied, or in a state where the focus isapplied to the whole screen, that is, the total focused state.

The electronic apparatus 100 may determine that a shutter pressing 606is performed by the user on the first preview screen 604 in the statewhen the first preview screen 604 is displayed.

When the shutter pressing 606 by the user is performed, the electronicapparatus 100 may apply the focusing to the first preview screen 604within a predetermined time (e.g., 0.1 second), and may display a secondpreview screen 608 to which the focusing effect is applied. At thistime, the electronic apparatus 100 may extract the distance informationusing the depth information, and may apply the focusing effect to thepreview screen using the distance information.

According to an exemplary embodiment, the electronic apparatus 100 mayapply an auto out-of-focus to the first preview screen 604, and maydisplay the second preview screen 608 to which the auto out-of-focus isapplied. According to an exemplary embodiment, the auto out-of-focus mayapply the out-of-focus effect to the remaining area except for a nearobject area 608-1 or apply the out-of-focus effect to the remaining areaexcept for a center object area 608-2.

Meanwhile, referring to FIG. 7, the electronic apparatus 100 maydetermine 704 that one drag input of a left or right drag is performedby the user in the state when the first preview screen 702 is displayedaccording to the launch of the camera application.

When one drag input of the left or right drag is performed by the user,the electronic apparatus 100 may change the DOF into a far distance or anear distance in the first preview screen 702 within a predeterminedtime (for example, 0.1 second) to apply the focus, and may display thesecond preview screen to which the focus effect is applied. For example,when the left drag input is performed by the user, the electronicapparatus 100 may change the DOF into the far distance in the firstpreview screen 702 to apply the focus, and may display the secondpreview screen 706 to which the focus effect is applied. On the otherhand, when the right drag input is performed by the user, the electronicapparatus 100 may change the DOF into the near distance in the firstpreview screen 702 to apply the focus, and may display the secondpreview screen 706 to which the focus effect is applied.

The electronic apparatus 100 may determine 708 a down drag input isperformed by the user in the state when the preview screen such as thefirst preview screen 702 or the second preview screen 706 is displayed.When the down drag input is performed by the user, the electronicapparatus 100 may capture (photograph) the image within a predeterminedtime (for example, 0.1 second), and may store the photographed image710.

According to an exemplary embodiment, when the down drag input isperformed by the user, the electronic apparatus 100 may obtain the depthinformation of the photographing moment while simultaneously obtainingthe image of the photographing moment from the second image signal, andmay match the image and the depth information to store the image and thedepth information. The electronic apparatus 100 may apply the focusingeffect to the stored image, using the stored image and the depthinformation.

The methods according to the various embodiments of the presentdisclosure may be in a form of program instructions executed throughvarious computer means to be recorded in a computer readable medium. Thecomputer-readable medium may include a program command, a data file, anda data structure individually or a combination thereof. The programinstructions recorded in the medium may be specially designed andconfigured for the present disclosure, or may be known to and usable bythose skilled in the field of computer software.

It will be appreciated that the photographing method according to thepresent disclosure may be implemented in the form of hardware, software,or a combination of hardware and software. Any such software may bestored, for example, in a volatile or non-volatile storage device suchas a ROM, a memory such as a RAM, a memory chip, a memory device, or anIC, or an optical or magnetic recordable and machine (e.g., computer)readable medium such as a CD, a DVD, a magnetic disk, or a magnetictape, regardless of the storage device's ability to be erased or thestorage device's ability to be re-recorded. It can also be noted thatthe photographing method according to the present disclosure may beimplemented by a computer or an electronic device including a memory anda controller, and the memory is an example of a machine-readable storagemedium suitable for storing a program or programs including instructionsthat implement embodiments of the present disclosure. Therefore, thepresent disclosure may include a program including a code forimplementing the apparatus or the method defined in the appended claimsof the present specification and a machine (computer, etc.)-readablestorage medium for storing the program. Further, the program may beelectronically transferred by a medium such as a communication signaltransferred through a wired or wireless connection, and the presentdisclosure appropriately includes equivalents of the program.

Furthermore, the mobile electronic device according to the embodimentsof the present disclosure may receive and store the program from aprogram providing device connected thereto in a wired or wirelessmanner. The program providing device may include a memory that stores aprogram including instructions for performing the photographing methodaccording to various embodiments of the present disclosure, acommunication unit that performs wired or wireless communication withthe electronic device, and a controller that controls the correspondingprogram to be transmitted through the communication unit at the requestof the electronic device or automatically.

Although the present disclosure has been described with an exemplaryembodiment, various changes and modifications may be suggested to oneskilled in the art. It is intended that the present disclosure encompasssuch changes and modifications as fall within the scope of the appendedclaims.

What is claimed is:
 1. An electronic apparatus comprising: a displayconfigured to display a screen; a depth sensor configured to output afirst image signal and depth information; an image sensor configured tooutput a second image signal; and a controller configured to control todisplay a preview screen on the display using the first image signal;obtain both depth information of a photographing moment and an image ofthe photographing moment using the second image signal, in response to arequest for photographing; and store the image and the depthinformation.
 2. The electronic apparatus of claim 1, wherein the firstimage signal is a low resolution image signal, and the second imagesignal is a high resolution image signal.
 3. The electronic apparatus ofclaim 1, wherein the controller is configured to apply a focusing effectto the image using the stored image and the depth information.
 4. Theelectronic apparatus of claim 3, wherein the focusing effect is aneffect of applying an out-of-focus to a remaining area except for apartial area of the image.
 5. The electronic apparatus of claim 4,wherein the partial area of the image is a predetermined area.
 6. Theelectronic apparatus of claim 4, wherein the partial area of the imageis an area selected by a user.
 7. The electronic apparatus of claim 1,wherein the electronic apparatus is a mobile phone.
 8. A method fortaking a photograph in an electronic apparatus, the method comprising:receiving a first image signal and depth information from a depthsensor; receiving a second image signal from an image sensor; displayinga preview screen on a display using the first image signal; obtainingboth depth information of a photographing moment and an image of thephotographing moment using the second image signal in response to arequest of photographing; and storing the image and the depthinformation.
 9. The method of claim 8, wherein the first image signal isa low resolution image signal, and the second image signal is a highresolution image signal.
 10. The method of claim 8, further comprising:applying a focusing effect to the image by using the stored image andthe depth information.
 11. The method of claim 10, wherein the focusingeffect is an effect of applying an out-of-focus effect to a remainingarea except for a partial area of the image.
 12. The method of claim 11,wherein the partial area of the image is a predetermined area.
 13. Themethod of claim 11, wherein the partial area of the image is an areaselected by a user.
 14. The method of claim 8, wherein the electronicapparatus is a mobile phone.
 15. A non-transitory computer readablemedium comprising program code that when executed by at least oneprocessor causes an electronic apparatus to: receive a first imagesignal and depth information from a depth sensor; receive a second imagesignal from an image sensor; display a preview screen on a display usingthe first image signal; obtain both depth information of a photographingmoment and an image of the photographing moment using the second imagesignal in response to a request of photographing; and store the imageand the depth information.
 16. The computer readable medium of claim 15,wherein the first image signal is a low resolution image signal, and thesecond image signal is a high resolution image signal.
 17. The computerreadable medium of claim 15, wherein the controller is configured toapply a focusing effect to the image using the stored image and thedepth information.
 18. The computer readable medium of claim 17, whereinthe focusing effect is an effect of applying an out-of-focus to aremaining area except for a partial area of the image.
 19. The computerreadable medium of claim 18, wherein the partial area of the image is apredetermined area.
 20. The computer readable medium of claim 18,wherein the partial area of the image is an area selected by a user.